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^ Abstract 

Niiturv,  oriKin,  and  treatment  of  systematic  errors  In 
measurements  ami  calibrations  are  discussed.  It  is  shown 
h»»  systematic  errors  can  vary,  how  random  errors  under 
om*  set  of  conditions  will  become  systematic  errors  under 
another  set  of  conditions  and  vice  versa.  Recommendations 
are  made  concerning  the  assignment  of  values  to  limits  of 
systematic  errors  of  measurements  and  standards. 

1.  Introduction 

Statistical  analysis  of  measurement  errors  has  become 
aa  additional  tool  inetrcdogists  are  using  in  an  increasing 
number  of  appUcations  aad  at  aa  Increasing  rate  in  order  to 
determine  numerically  the  accuracy  of  measurements  and 
the  confidence  attached  to  quoted  accuracies.  Methods  of 
evaluating  random  errors  are  well  known  and  in  widespread 
use.  This  paper  examines  the  main  aspects  of  systematic 
errors  and  methods  to  evaluate  them;  it  discusses  the 
nature  of  the  fluctuating  boundaries  between  systematic  and 
nndmn  errors  in  measurements  and  calibrations. 

The  systematic  error  of  a measurement  or  calibration 
may  be  defined  as  the  largest  possible  estimated  difference 
between  the  true  value  of  a measured  quantity  aad  the  mean 
value  towards  which  the  measurement  or  calibration  pro- 
cess tended  as  a limit  at  the  time  of  the  measurement  and 
which  difference  could  not  be  eliminated  for  technical  or 
economic  reasons;  it  is  aa  estimate  of  the  maximum  limits 
of  the  effects  of  all  orror  sources  known  or  suspected  to 
exist  which  tended  to  offset  mUformly  all  results  of  repeated 
applicatioas  of  the  same  measuring  or  calibration  process 
at  die  time  of  the  measurement.  Thus,  ttw  "systematic 
error"  is  not  aa  error  in  die  accepted  sense  of  the  word 
"error",  but  rather  aa  uncertainty;  however,  the  term 
"error"  will  be  used  here  for  brevity  and  because  it  has 
been  firmly  established  by  custom. 


es  of  Measurement  Errors 


A.  General 


Ths  error  or  nacertainty  of  a measurement  can  be 
divided  into  a fixed  part  aad  a variable  part,  where  it  should 
be  nMerstood  that  the  fixed  part  remalas  approximately 
fixed  only  for  ths  duration  of  the  measurement  process.  For 
shorter  durations,  the  variable  part  is  likely  to  be  smaller, 
and  over  longer  time  intervals,  the  phenomena  causing  ths 
"fixed”  error  can  be  expected  to  vary  also,  thus  making  the 
variable  part  of  the  error  larger  at  the  expense  of  the 
"fixed"  part.  As  tte  time  laterval  under  cooslderation 
becomes  very  large,  any  initially  fixed  error  will  probably 
vanish  aad  all  errors  are  likely  to  become  variaUe. 

Ths  errors  or  uaoertaiaties  of  a aMasnrement  can  also 
be  categorlsad  by  a random  part  aad  a systematic  part.  The 
random  error  is  part  of,  but  not  necessarily  identic^  with, 
the  variable  error;  aad  the  systematic  error  includes  the 
fixed  error,  but  may  also  include  a portion  of  the  variable 
part  of  the  error. 

All  determinable  errors  which  occur  during  one  meas- 
urement process  aad  which  do  not  appear*  to  be  part  of  the 
random  error  must  be  accounted  for,  otherwise  the  process 
may  not  be  under  statistical  control.  But  ".  . . until  a 


measurement  operation  . . . has  attained  a state  of  statiatiiml 
control  it  cannot  be  regarded  in  any  logical  sense  as  meas- 
uring anything  at  all.  - "Capability  of  control  means  that 
either  the  meaaurennents  are  the  product  of  an  identifiable 
statistical  universe  or  an  orderly  array  of  such  onirerses, 
or  if  not,  the  physical  causes  preventl^  such  Identlflcatlan 
may  themselves  be  identified  snd,  if  desired.  Isolated  aad 
suppressed. "1 

No  general  statement  concerning  the  relatire  magni- 
tude of  random  and  systematic  errors  can  be  made,  la 
some  disciplines,  the  best  measurements  that  can  be  made 
have  systematic  errors  very  much  smaller  than  random 
errors.  In  others,  the  systematic  errors  Car  outweigh  the 
random  errors,  even  for  the  best  measurements  which  the 
present  state  of  the  art  permits. 

B.  Systematic  Ertora 


A systematic  error  is  that  value  which,  when  added  to, 
or  subtracted  from,  the  limiting  mean  value  of  a measure- 
ment process  of  a quantity,  produces  a range  in  which  the 
"true  value”  of  that  quantity  Is  believed  to  lie.  We  hope  that 
the  systematic  error  is  always  equal  to  or  larger  fiiaa  the 
difference  between  the  "true  value"  of  the  quantity  and  that 
value  toward  arhich  the  measuring  process  of  the  tpiantity 
tends,  this  tendency  not  being  caused  by  chance  fluctuations 
of  any  part  of  the  measurement  system. 

The  systematic  error  is  a bias,  but  generally  unknowa 
in  magnitude  and  direction,  because  the  "true  value"  is  an 
abstract  concept  which  cannot  be  physically  realised.  More 
pragmatically  ".  . . the  systematic  error  ...  of  a meas- 
uring process  refers  to  its  tendency  to  measure  something 
other  than  what  araa  intended.  . . Oi  first  thought,  the 
'true  value'  of  the  magnitnde  of  a particular  quantity 
appears  to  be  a simple  straightforward  concept.  On  careful 
analysis,  however,  it  becomes  evident  that  the  'true  value' 
of  the  magnitnde  of  a quantity  is  intimately  linksd  to  the 
purposes  for  arhich  kn^ledge  of  the  magnitude  of  this  quan- 
tity is  needed,  and  cannot,  in  the  final  analysis,  be  mean- 
ingfully aad  usefully  defin^  in  isolation  from  these  nseds."^ 

A systematic  error  is  always  aa  estimate  of  a range, 
aad  estimatlag  it  reqalres  a profound  uadsrmandiag  of  the 
measurement  process  if  a realistic  figure  is  to  be  arrived 
at.  A quoted  figure  for  ths  estimate  of  a sjrstsmstic  error 
means  tlwt  ths  metrologtst  believes  that  ha  would  have 
detected  - aad,  therefore,  been  in  a posittoa  to  rsduoe  - aagr 
error  larger  than  that  quoted  as  the  systematic  error,  tt 
implies  that  the  actual,  unknown  error  could  bo  anyw  here 
within  that  range.  And  ".  . . the  wiser  snd  more  careful  the 
experimenter's  search  for  sjrstematic  errors,  and  the  more 
completely  he  has  eliminated  them,  the  less  likely  is  it  to  lie 
near  the  limits  of  the  range. 

Dorsey^  describes  the  concept  of  the  systematic  error 
as  being  ".  . . used  to  cover  all  those  errors  which  eai  oot 
be  regarded  aa  fortuitous,  as  partaking  of  the  nature  of 
chance.  They  are  characteristics  of  the  system  involved  In 
the  work;  they  may  arise  flrom  errors  in  theory  or  in 
standsrds,  from  imperfections  in  the  apparatus  or  in  ths 

*The  word  "qipear''  is  used,  ".  . . becaaoe,  as  is  always 
the  ease  in  trying  to  find  a law  contiDlllag  a phenomeitoe, 
we  can  never  be  sure  that  we  have  dlsoovered  ths  law. 
Obviously  such  appearance  is  not  Mflleleet  in  the  logical 
sense  although  it  must  be  in  ths  practloal  senae.  "H 


laboratory  A meaauraa  the  atandard.  the  reaulUag  meaeared 
valuea  will  differ  aligbtty  from  the  oaea  obtalaed  earlier  or 
later.  However,  once  a value  and  Ita  limlta  of  unoeitalnty 
are  rmwrted  to  ua.  they  are  fined,  no  more  varUfate,  feast 
of  all  "random  variables",  and  Am  entire  uncertainty, 
including  random  error,  must  be  oonsldered  by  us  as  a 
systematto  error  when  we  need  to  apfdy  it.  The  necessity 
of  tbe  foregoing  was  discussed  in  detail  by  Youden  in  Refer- 
ence IS.  (See  also  Ref.  10. ) 

In  part  m.  B. , under  "varying  Systematic  Errors  of  Stand- 
ard", we  shall  see  hpw  trend  charts  can  help  us  "unfreese" 
the  random  error  and  (he  variable  part  of  the  systematic 
error  of  laboratory  A in  the  long  run  to  reduce  the  total 
uncertainty  accompanying  the  value  of  our  standard.  But 
without  sud>  tedmiques,  the  total  uncertainty  of  a higher 
echelon  measurement  bdomes  a systematic  error  in  its 
lower  echelon  application.  (See  also  Reference  15. ) 


obaerver,  from  false  assumptions,  etc  ... . They  are 
frequeBtly  caUed  'constant  errors, ' and  very  often  they  are 
non  stent  throughout  a given  aet  of  determinations,  but  such 
constancy  need  not  obtain  . . . 

"b  eearoblng  for  systematic  errora,  the  logical  pro- 
oedare  is  to  make  a series  of  measurements,  then  to  change 
something  awl  to  make  another  series,  and  to  compare  the 
means  of  the  two  groups.  This  will  be  repeated  as  often  as 
may  seem  necessary.  None  of  the  series  can  be  long,  for 
an  extended  delay  <^ers  opportunity  for  unanticipated 
diangea  to  occur.  If  the  two  means  being  oompued  do  not 
differ  by  more  than  the  sum  of  their  technical  probable 
errors,  their  difference  is  of  no  physical  significance  - it 
proves  nothiiv.  Hence,  ibe  presence  of  a systematic  error 
that  doaa  not  exceed  the  sum  of  tbe  tedmical  probable 
errors  of  the  two  grota>s  of  observations  used  in  Ae  search 
cannot  be  establlahed  wiAout  great  dlflictdty,  if  at  all  . . . 

"In  the  absence  of  such  a search,  the  worker  can  do 
no  more  than  hope  that  all  is  going  wdl.  The  fact  that  he 
seea  no  reason  tor  suspecting  Ae  presence  of  an  unknown 
systematic  error  is  of  no  importance  at  all,  no  matter  who 
the  obaerver  is.  The  really  troublesome  errors  are  exactly 
those  that  are  not  suspected.  The  expected  ones  can  usually 
be  to  some  extent  diminated. 


'stematlc  Errors  <rf  Btandards 


The  certification  uncertainty  of  our  standard  is  not  Ae 
only  uncertainty  Atroduoed  by  the  standard.  A general, 
anoAer  uncertainty  term  must  be  found  which  combines  all 
those  fluctuations  A Ae  value  it  represents  as  may  be 
caused  by  changes  A Ae  standard  Itsdf,  usually  due  to  drift, 
AstablHty,  or  use  (wear),  or  by  external  Influences  which 
temporarily  affect  Ae  value  of  tbe  standard,  such  as  tem- 
perature, barometric  pressure,  air  ionization,  solar 
activity,  etc. , and  which  are  not  oantrolled  - and  may  not 
even  be  known  to  have  an  effect  - at  the  time  Ae  value  of 
Ae  standard  is  betog  determAed.  Some  of  Aese  effects  may 
at  least  partly  be  accounted  for  A Ae  random  error  of  Ae 
measurement  process  employed  when  determining  Ae  value 
of  Ae  standard  But,  unlike  Aat  part  of  Ae  random  error 
which  is  entirely  caused  by  Ae  measuring  process  and  Ae 
effect  of  which  will  remata  constant  once  Ae  measuring 
process  is  terminated  and  Ae  value  of  Ae  standard  reported, 
Ae  latter  effect  will  oonttoue  to  change  Ae  value  at  Ae 
standard,  adding  to  Ae  uncertainty. 


Sometimes  economics  dictate  Ae  use  of  a coarse 
measurement  system  whose  major  component  of  systematic 
error  can  be  determAed  by  comparison  wiA  a more  accu- 
rate measurement  system.  This  component  can  then  some- 
times be  aooounted  for  by  a correction.  The  remata Ag 
systematic  error  will  Aereby  be  reduced;  it  may  even 
become  negligibly  small,  but  it  wUl  Aeoretically  never 
become  zero.  However,  Ae  systematic  error  of  Ae 
coarser  system  may  vary,  and  it  may  not  be  practical  to 
determAe  it  each  time  a measurement  is  to  be  made.  A 
Ala  case,  no  correction  may  be  applicable,  and  Ae  com- 
parison WiA  a more  accurate  system  may  only  serve  to 
estimate  Ae  range  of  Ae  systematic  error  of  Ae  coarser 
system  more  accurately  than  would  be  possible  without 
recourse  to  a more  accurate  system.  This  is  Ae  case,  for 
Astanoe,  WiA  a working  Astrument  wiA  a rated  accuracy 
or  uncertaAty  at  1%  rouUneiy  caiibrated  by  working  stand- 
ards WiA  0. 1%  uncertaAty  limits.  The  1%  uncertaAty  of 
Ae  working  Astrument  is  its  systematic  error  contri^tion 
to  all  measurements  made  wiA  it,  unless  corrections  are 
provided,  A which  caae  Ae  systematic  error  may  be  less. 
The  calibration  against  the  standards  then  serves  to  assure 
Aat  AA  systematic  error  doea  c^t  exceed  1%. 


A general,  we  would  not  know  whether  differences  A 
subsequent  values  of  our  standard  as  certified  by  Labora- 
tory A are  caused  by  Ae  random  error  at  Laboratory  A 
only,  by  changes  A Laboratory  A's  systematic  error,  by 
changes  A Ae  value  of  Ae  standard  Itself,  or  by  a combAa- 
tion  of  Aese  causes.  To  be  able  to  assign  to  a standard  an 
uncertainty  which  Includes  all  eiqmrienced  effects  of  vari- 
ation from  Ae  unknown  and  unknowable  true  value  of  the 
standard,  we  must  analyze  Ae  history  of  Aat  standard. 


A valuable  tool  A analyzing  and  diq;ilaying  Ae  history 
of  a standard  is  a Trend  Chart  (see  Figures  1 and  2).  The 
dots  and  x's  on  Ae  Trend  Charts  represent  values  reported 
by  Ae  National  Bureau  of  Standards  (NBS)  for  Ae  standards 
A question  at  Ae  indicated  dates.  Their  dispersion  pattern 
suggests  a Trend  LAe  whidi  represents  Ae  best  value  known 
of  each  standard.  The  Trend  Line  value  of  Ae  standard  is 
most  lAely  a more  accurate  value  of  Ae  standard  Aan  Ab 
latest  NBS  reported  value,  a'td  Ae  Trend  Chart  has  on 
occasion  served  to  correct  errors  A Ae  NBS  reported  values. 
The  Aspersion  of  the  poAts  shows  graphically  Ae  effect  of 
all  Ae  variables  influencing  Ae  known  value  ct  Ae  standard 
over  Ae  long  run,  such  as  possible  long  term  variations  in 
Ae  systematic  error  of  Ae  standardizing  Laboratory  (NBS 
in  Ais  case),  its  random  error,  and  actual  changes  of  Ae 
standard.  A fact,  Ae  Trend  Charts  of  Ae  gage  blocks 
indicated  a shrinkage  of  Ae  blocks  before  tte  reasons  for 
such  shrinkage  were  known  (wear  effects  could  be  excluded  in 
Ae  caae  of  Ae  blocks  represented  by  Figure  2). 

Furtbermore,  Ae  calculated  envelope  around  Ae  poAts 
at  two  or  Aree  sigma  at  Ae  points'  dispersion  around  Ae 
Trend  Line  represents  Ae  total  tmoertainty  at  the  value  of 
Ae  standard,  excluding  Ae  systematic  error  of  the  standard- 
izing laboratory.  Tbe  systematic  error  of  Ae  atandardlzing 


ling  Nature  of  Errors 


The  boundaries  between  systematic  and  random  errors 
are  fluetnatiag.  What  appears  as  a systematic  error  under 
one  aet  at  eircumstanoes  may  appear  as  a random  error 
under  another  and  vice  versa.  Just  as  a sculpture  changes 
its  appearance  to  a viewer  walking  around  it.  The  counae- 
quenoea  at  Ala  fact,  aa  Aey  affect  Ae  evaluation  of  uncer- 
taAtiea  at  standards  A a laboratory,  are  Illustrated  by  a 
few  examploe. 


A.  A Random  Error  Becom 


When  a standards  laboratory  A,  say  Ae  National 
Bureau  at  Standards,  calibrates  a reference  standard  for 
us,  laboratory  A reports  to  us  Ae  value  of  Ae  standard,  as 
it  has  determined  H 1^  its  measurements,  and  the  limits  of 
laicertainty  at  Aat  measured  value.  Part  at  laboratory  A's 
uncertainty  originates  from  its  random  error,  part  from  Its 
systematic  error.  Random  error  and  part  at  Ae  systamatic 
error  can  be  expected  to  add  a small  variable  component  to 
laboratory  A's  measured  value  A such  a way  that  each  time 


Where  oomponent  megnitudee  ere  pUlely  added  to 
arrive  at  an  overall  aaagnUude,  aa  in  llie  atacUng  oi  gage 
falocka  or  the  aeriea  conneetion  ei  retlatore,  ayatematic 
errora  are  alao  added.  An  example  la  ttie  aeriea  of  reaia- 
lora.  Figure  A.  witfi  valuea  aa  in  Table  4. 


a.  Berlea- Parallel  Realatom 

A aetamik  of  aeriea  parallel  eeaaeeted  reaMora  amy 
aerve  to  iUnatmte  flm  paopagathia  ti  errora  la  a noa^laear 
caae.  The  aetamefc  la  aa  la  Figure  B artih  vriuaa  aa  in  Talte  B. 


Figure  A.  Example  of  Linear  Accumulation  (d 
Systematic  Errora,  Serlea  Connected 
reaiatora  or  staged  gage  hiochs 


TaUe  A 

Valuea  of  Reaiatora.  Figure  A. 


Figure  B.  Serlea- Parallel  Conaectad  Reaiatora 


TaUeB. 

Valuea  of  Reaiatora,  Figure  B 

Total  Uncertainty  of 
Meaeured  Value 


Total  Uncertainty  of 
Measured  Value 

Element 

Measured  Value 

Symbol 

ini 

in  Ohms 

Ilement 

Measured  Value 

Symbol 

kil. 

in  Ohms 

“1 

1000  0 

11 

10  0 

«1 

10  MO 

•ri 

1» 

lOOkO 

«2 

500  0 

31 

15  0 

SkO 

*R2 

*R3 

5% 

260  0 

«3 

130  0 

S% 

6.50 

350  0 

01 

17.5  0 

“4 

10  0 

•r4 

» 

0.50 

"4 

150  0 

% 

51 

7.5  0 

R = 

10  005. 14  kO 

«R 

= 

100. 257  kO 

The  equation  for  R,  Figure  B, 

is 

The  total  resistance  R of  this  aeriea  of  reaiatora  is  10  005 
140  ohms  wltti  aa  uncertainty  of  100  257  Ohms  or  HE. 

Or,  applying  the  propagation  of  error  equation  <1): 

The  equation  for  R is 

R = R,  + R2  + R3  + R4 

= 10  005  140  a 
R = f (Rj#  R2t  Rjf  R^) 

*R  = 'Si'b,  * “Ift  *R2|  * |ife  ‘RsI  ^ < 

aR. 

sb;*r4 

aR  aR  . aR  _ aR  , 

?ff,  = 3R^“  ^ ss;  * 

*r”*r  "^“r  **r.'*'*r 

1 2 a 4 

> 100  267  0 >=  1%  of  10  MO 


"3*4 

R ~ f(R|.  R2.  Rj.  R^l 

Subatttuting  R,  Equation  B,  for  ()  In  Equation  (1),  the  residt 
la  again  aa  la  E^iiuion  (A).  The  partial  derivatives  of 
Kqimtion  fA)  are  here: 


^ '(iw)  “ 

Thus  Equation  A beeomes 

e,l  > 10  0 4 IS  0 4 0.00  X 17.5  0 4 0.40  x 7.6 

•00.250°  1. 


Thia  example  lUuatratea  the  oalouUtlon  of  the 
ayatemaUo  error  incurred  in  measuring  the  value  of  a 
1 gigaohm  resistor  (X)  against  a 100  kiloohm  standard 
resistor  (A)  whose  value  was  determined  earlier  with  a 
total  imcertabity  of  0. 018%.  The  apparatus  used  in  the 
measurement  is  a differential  high  resistance  bridge  shown 
in  Figure  C. 


This  bridge  is  first  balanoed  with  resistor  X oonneotod 
to  terminals  1 and  2 and  with  the  calibrated  decade  resistor 
set  to  sero  (Bi^.  Resistor  X is  then  dlscoraieoted  sad  the 
bridge  haiaaoed  agaia  btjr  iaoreaaiag  the  realstanoe  of  arm 
B by  an  amount  B2,  using  the  decade  resistor.  The  meas- 
ured value  of  X is  then 


3 226  834  ohms  or  approsimatety  3. 2 x 10”  ohms, 


The  value  of  X,  using  equation  (C).  calculates  to  be  1. 009  6 
X 108  ohms,  so  that  the  limits  of  uncertainty  due  to  systematic 
error  of  the  bridge  circuit  and  the  standard  are  at  * 0. 32%. 


la  the  value  of  the  voltage  divider  C/D, 


Figure  C.  Differential  High  Resistance  Bridge 


The  values  and  uncertainties  of  the  individual  elements  of 
Equation  (C)  are  found  as  tabulated  in  Table  C. 

Table  C 

Values  of  Elements,  Equation  (C) 


Total  Uncertainty  of 
Measured  Value 

Element  Measured  Value  Symbol  in  % Magnitude 


A 100  005  0 e^  0.018%  18  0 

9.905  0 eg  0.27%  0.027  0 


N 


1.000  ”n  <>’011%  0.000  11 


Applying  Equation  <B)  wketw  Q sow  must  be  teplaoed  by  Xof 
Equation  (C),  the  systematic  error  ot  the  resislanoe  meas- 
urement due  to  the  uncertainty  of  the  bridge  elements  then 
becomes; 


The  partial  derivatives  of  X with  respect  to  A,  Bg,  and  N are 
then,  respectively. 


Figure  1.  Trend  Cherts  of  Two  Thornes  Type  Stenderd  ResistorB 


lelioretory  Is  possibly  in  pert  included  in  s Trend  Chert 
spsnntng  s long  period,  but  we  don't  know  how  much  of  it  is 
indudsd,  if  snyMng.  Thus,  to  estimste  the  totsl  unoer- 
tsinty  of  the  stsndsrd's  vslue  st  sny  time,  we  must  sdd  the 
reported  systemstic  error  of  the  stsndsrdising  Isborstory 
to  ttie  widA  of  the  envelope  on  the  Trend  Chert.  And  this 
totsl  uneerteinty  of  As  stenderd  is  pert  of  our  systemstic 
error  when  we  use  Ae  standerd  as  a basis  for  measure- 
ments. Note  that  Ais  systametic  error  Indudes  random 
vertabiea  whidi  have  hew  froeen  for  the  time  being  and 
must  be  considered  es  being  pert  of  the  systemstic  error. 

For  a detailed  deaeriptfen  on  how  to  construct  Trend 
Charts,  see  References  8*  and  9. 


As  Ae  Trend  Line  vdue  of  these  standards  is  Ae  best 
known  vdue,  Ais  is  Ae  vdue  assigned  to  the  resistor  d 
any  time,  regardless  of  Ae  latest  cdAratlon  vdue  of  Ae 
resistor  reported  to  us  by  NBS.  Note  Ad  Ae  rqxnied 
vdues  have  been  Jumping  ig)  or  down  by  as  mudi  as  one 
part  per  million  from  one  edibrdtoo  to  Ae  next.  B we 
wodd  always  assign  Ae  Isted  edibratioa  vdue  to  these 
standards,  our  entire  measurement  system  would  experi- 
enoe  Aese  ripples,  ripples  which  A Ae  end  wodd  caned 
eadk  other  around  Ae  Umitiag  mean  value,  Bie  Trend 
Line  valoe.  Astead,  we  oompute  a new  Trdd  Line  vdue, 
a new  mean  vdue  A Ais  case,  every  time  a new  oatlfara- 
tton  vdoe  A obtained.  Thus,  every  now  caUbratAn  ddue 
wfll  dumge  Ae  new  mean  only  iasignlfieaaay.  If  d all. 
Hence  the  Trend  Line  vdue  asaigned  to  Ae  standard  will 
remsA  stable  over  Ae  yeara. 

The  control  limits  represent  the  llmlA  of  unoertaAty 
of  Ae  Trend  Line  vdue  sad  hanos,  represent  Ae  llmtts  of 
unoertaAty  due  to  variable  error  oomponanA  of  the  vdue 
which  w«  assign  to  dm  standard.  They  onooaMaMs  many 
more  variabiss  aad  sources  of  uncertainty  than  those 
expurianosd  by  NBS  A the  edibratian  of  Ae  sAndarda.  The 
liadA  of  mwertatoty  shod  the  Trend  Line  of  dm  fird  five 
vdues  of  Baslator  1,  Figure  1,  are  d 0.  T7  mioroohaM  from 
Ae  Trend  LAet  adding  to  Smt  Sie  estlmdsd  limits  of  the 
ayatensdie  error  by  NBS  of  shod  0.8  mieroohms,  Ae  totd 
unoertaAty  of  the  value  of  Redstor  1 (1. 800  OU  48  ohmaj  is 
1. 11  nderwhau.  This  A As  systematic  error  intinduosd 


Figure  1 shows  Ae  Trend  Charts  of  two  standard 
reaistoru  oonstructsd  to  Jdy  18M  and  January  1888 
reapeotively  (dashed  lines).  At  thd  time,  the  bed  vduss 
for  Aese  two  resistors  were  l.MO  OU  43  and  1.000  013  44 
(Trend  Lines).  A Ae  absence  of  any  toformation  to  die 
contrary,  the  Trend  Lines  were  bdieved  to  be  boritonM, 
assuming  no  detectable  ehange  A Sto  vdues  of  Aese 
resistors  fur  the  near  future  (two  to  Aree  years).  Because 
of  Ae  scarcity  of  the  potato  available,  l-si^na  oontrol 
llnHA  were  drawn  ba^  on  the  soatAr  of  ^ potoA  around 
their  average  (Ae  Trend  Line  in  Ais  case);  Ais  gives  a 
98  percent  confidence  thd  the  "true  vdue”  (i.e.  Ae  limit- 
ing mean  vdue  of  dl  experlenoed  variables)  lAs  between 
those  control  limits,  Asregardlag  for  Ae  atomest  any 
systoiwaUc  error  of  NBS.  As  more  poAta  become  available 
3-stgma  oontrol  limlU  would  reduce  Ae  risk  of  Ae  limiting 
mean  value  beAg  outside  ttie  oontrol  IlmiA  to  an  Astgntfl- 
cant  8. 3 percent. 


v*  am  IMS 

TIME 

(MONTH/VEAm 

Figure  2.  Trend  Charts  of  Two  Gage  Blocks 


by  the  standard  to  any  measurement  made  with  it.  Note  that 
the  0. 77  microohm  control  limits  represent  only  95  percent 
confidence  that  this  range  brackets  Ae  "true  value  of  the 
standard.  M we  want  to  increase  did  confidence  limits  to 
99. 73  percent  (S-aigma  equivalent),  the  control  limits 
would  have  to  be  widened  to  1. 77  microohms  about  the 
Trend  Line  value  for  a total  unoertsinty  of  1. 77  ■i’  0.  S - 
2. 27  mioroohma.  bi  order  to  narrow  diese  limits  of 
unceitaiaty.  Me  need  a longer  history  widi  more  values 
as  exemplified  by  die  Trend  Chart  of  Resistor  0,  Fig- 
ure L 

The  Orst  five  values  of  Resistor  0 yielded  a Trend 
Line  (average)  of  1. 000  013  44  ohms  widi  95  percent  oonfi- 
denoe  Ihnlta  of  a 0. 65  aMcroohms.  A sixdi  value  obtained 
in  April  1667  of  L600  013  5 ohms,  as  reported  fay  NB8, 
fsve  rise  to  a new  aaalvied  value  of  Reeiator  Rof 
*•*>0  613  47  ohms  widi  66  percent  confidenoe  limits  nar- 
rowed down  to  6.46  mioroahma  and  a total  ipwertataty  of 
atindBtd*a  valaa  of  0. 46  a o.  5 (Ostimated  NBS  ayatem- 
atto  emr)  > 1 micmnhm. 

MSay  a laboratory  la  using  dm  latest  calibraUon 
vtfoe  of  dtoir  Otmuiard  as  the  value  assigned  to  it  intil  die 


next  calibration  of  diet  standard  and  use  die  uncertainty 
reported  by  the  calibrating  laboratory  (NBS  in  our  case) 
as  the  total  uncertainty  of  the  standee's  value.  The  fallacy 
of  diat  practice  becomes  evident  from  die  above  discussioa. 
These  laboratories  in  fact  experience  a fhr  higher  uncer- 
tainty than  they  are  aware  of. 

Going  back  to  Resistor  L Figure  1,  we  note  that  the 
next  reported  calibration  value  (September  1968)  was 
1. 000  011  6 ohms  and  fell,  dier^re,  sligbdy  outside  the 
oontxol  limits.  We  rejected  the  value  as  bei^  In  error, 
revising  that  we  stood  a 5 percent  change  of  rejectliv  a 
prfeotly  valid  value.  But  a new  measurement  oonfirmed 
that  the  September  1968  value  was  erroneous. 

Figure  2 shows  Trend  Charts  of  two  special  gage 
blocks  to  illuatrate  the  fact  diat  aome  standards  undergo 
fTMhiri  changes  la  dme.  In  such  cases,  a Least  Squares 
Trend  Line  can  be  constructed,  depicting  with  sufficient 
accuracy  the  behavior  of  the  standkrd  and  permitting  a 
foreease  of  its  most  likely  value  tor  the  near  future.  Since 
the  elope  of  such  a Least  Squares  line  U also  burdened 
with  some  uncertainty,  dw  bend  of  uncertainty  around  the 
forecast  future  values  of  such  standards  continues  to  widen 


UK  tilin'  INIIKII'SM  K :is  sliiiuii  ill  ri|;iiiv  2,  rx|ili'KKinK 

ininirriL'Ult.v  om  unrrrtaiiitv  ulmul  thi'  uxael  xului  nl  llif 
ulupi'.  This  widiiniiiK  bundwiiHh  uf  unccrtainl)  also  ti'llu 
U8  when  we  need  tu  have  the  utandard  recalibrated,  lest  iU 
uncertainty  grows  intolerably  large  fur  the  requireMenta  of 
our  products. 


a measurement  ernn  of  a given  magnitudei,  and  In  ueeouni 
for  them  or  eliminate  thi'm,  if  it  in  known  how  much  ol  a 
phenomenon  causew  a given  amount  of  a measurement  error 
and  if  we  are  capable  - technically  and  economically  - uf 
measuring  the  phenomenon  and  making  the  required  adjust- 
ment, the  systematic  error  is  detennioablc  and  should  be 
eliminated.  If  the  state  of  the  technology  or  economics 
forbid  a determination  and  subsequent  elimination  of  the 
systematic  error.  It  remains  unknown  and  must  be  estimated. 
The  following  example  is  intended  to  illustrate  the  transitory 
nature  at  the  limits  between  systematic  and  random  errors 
of  a measurement  process. 


The  dots  represent  the  values  known  at  tlie  time  at 
which  the  Trend  Charts  were  constructed  and  on  which  the 
Trend  Charts  are  based.  The  x's  represent  values  obtained 
later  and  are  shown  to  illustrate  the  predictive  value  of  the 
Trend  Charts.  The  Trend  Charts  arc,  of  course,  updated 
each  time  a new  value  is  obtained. 


An  unknown  standard  resistor  with  a nominal  value  of 
1000  ohms  was  compared  against  a known  standard  resistor 
one  day  between  10:00  s.m.  and  10:20  a.m..  A ratio  set 
was  u^  for  comparing  the  two  resistors  in  air.  The  five 
values  obtained  were  plotted  on  a chart.  Figure  4.  The 
ambient  temperature  was  25.4  degrees  Celsius,  varying  by 
less  dian  0. 1 degree  during  that  time.  The  ten^rature 
coefficients  oi  resistance  of  the  two  resistors  were  known, 
and  all  plotted  values  were  corrected  for  a base  tempera- 
ture of  25  degrees  Celsius. 

The  effect  of  temperature  on  the  entire  measuring 
system  was  not  Ic'own.  The  ambient  temperature  varied 
between  approximately  25. 5 and  24.5  degrees  C at  a typical 
rate  of  approximately  0. 5 degrees  C per  hour,  tt  could, 
therefore,  be  assumed  that  the  system  was  not  at  thermal 
equilibrium  at  any  time;  and  the  effect  of  this  inequilibrium 
on  the  result  of  a sini^e  set  of  measurements  would  have  to 
be  estimated  and  a numerical  value  assigned  to  this  effect 
as  part  of  the  systematic  error  if  the  value  of  the  unknown 
resistor  had  to  be  determined  on  the  basis  at  the  first  set 
at  measurements.  The  nearly  perfect  agreement  of  the 
values  obtained  in  the  first  set  indicates  that  the  resolution 
of  toe  ratio  set  was  insufficient  for  the  measuring  system 
to  respond  significantly  to  random  fluctuations.  An  analysis 
of  toe  random  error  of  tois  set  based  on  more  toan  an 
inspection  of  toe  data,  where  four  values  are  Identical  and 
only  one  differs  from  toe  otoer  four  by  toe  smallest  unit 
possible  to  resolve,  would  be  of  little  value. 


As  time  progresses,  however,  technology,  the 
methods  used  in  calibrating  the  standards,  and  frequently 
the  accuracy  requirements,  change.  There  come  times 
then  when  we  can  no  longer  continue  the  Trend  Charts  as 
before.  New  values,  obtained  fay  different  measurement 
methods,  are  no  longer  readily  comparable  with  old  ones. 

As  an  example,  rffer  to  Figure  3,  toe  Trend  Chart  of 
Resistor  II  in  the  1970's.  The  uncertainty  values  attached 
to  toe  calibration  values  of  this  resistor  in  the  1960's 
(Figure  1)  were  at  best  within  1 microohm;  the  uncertainty 
values  quoted  by  NBS  for  toe  values  charted  in  Figure  3 are 
typically  around  0. 09  microohms.  The  new  Trend  Line 
value  assigned  to  tois  resistor  is  now  1. 000  013  934  ohms, 
and  3-sigma  equivalent  control  limits  are  at  * 0.  SO  micro- 
ohms from  that  Trend  Line.  (Two-sigma  control  limits 
are  also  shown  as  light  dotted  lines  at  ± 0. 18  microohms  for 
comparison  purpoaea,  showing  how  the  closer  agreement 
between  toe  plotted  points  results  in  a much  narrower  band 
in  which  the  "true  vidue"  of  toe  resistor  is  likely  to  lie. ) 
KBS'S  systematic  error  is  now  reduced  to  about  0. 03 
microohms,  so  that  we  can  now  say  that  the  best  known 
value  of  tois  resistor  is  "1. 000  013  93  ohms  with  a total 
uncertainty  of  0. 54  micitxtoms,  derived  from  bounds  of 
*0. 03  microohms  on  the  systematic  error  and  a computed 
random  error  of  0. 50  microohms  based  on  a two-tail 
0. 0027  probability  value  for  3 degrees  of  freedom." 


The  magnitude  of  a systematic  error  of  a measure- 
ment process  is  established  I9  toe  capability  and  willing- 
nesa  ci  the  metrologlst  to  measure  those  phenomena  whidi 
cause  systematic  errors,  to  find  toeir  quantitative  effects 
(1.  e. , what  quantity  of  the  phenomenon  is  required  to  cause 


The  correct  value  of  toe  standard  resistor  had  been 
determined  by  a more  accurate  measurement  process  before 
and  after  toe  measurements  described  in  this  example  and  was 
KKN).  0120  ohms  with  a constant  systematic  error  aiui  wito  a 
random  error  of  considerably  less  toan  1 ppm. 


Figure  3.  Trend  Chart  of  Recent  Vdues  of  Resistor  D 


Figure  4.  Two  Seta  of  Meaaurementa  of  a lOOO-ohm  Standard  Realator 


Between  2:00  and  3:00  p.  m.  of  the  aame  day, 
another  set  of  meaaurements  was  made  nd  is  also  plotted 
on  the  control  chart.  The  ambient  temperature  was  24. 9 
degrees  Celsius.  Again,  the  five  measured  values,  cor- 
rected for  the  base  temperature,  agreed  very  well; 
perfectly,  as  a matter  of  fact.  But  they  differed  markedly 
from  those  obtained  previously.  It  could  be  said  that  each 
set  of  measurements  was  under  (simple)  statistical  control 
individually;  but  bodi  sets  together  indicate  an  out-of-oontrol 
condition,  the  two  seta  being  offset  from  one  another  by  a 
systematic  error.  Since  no  means  were  available  to  keep 
the  ambient  temperature  more  stable,  and  since  the  effect 
of  temperature  Inetpillibrlum  on  the  components  of  the  meas- 
uring system  was  not  known,  this  systematic  error  is 
unknown.  If  it  had  been  possible  to  predict  the  systematic 
error  due  to  temperature  difference  and  inequilibrium  or  to 
maintain  the  ambient  temperature  more  closely,  the  meas- 
ured values  could  have  bron  adjusted  for  the  temperature 
inequilibrium,  or  the  condition  causing  the  inequillbrlum 
could  have  been  avoided.  (The  effect  of  temperature  on  the 
systematic  error  of  the  resistance  measurement  Is  given 
here  as  one  example  only.  Many  other  sources  of  system- 
atic error  exist  in  practice  and  may  influence  the  meas- 
urement uncertainty.) 

The  resistance  of  the  unknown  standard  resistor  was 
then  measured  repeatedly  under  similar  circumstances. 

The  results  of  ttiese  measurements  were  entered  on  the 
chart  shown  in  Figure  5.  Each  plotted  point  is  the  mean  of 
five  successive  determinations  at  the  resistance  of  the 
unknown  corrected,  as  far  as  possible,  for  25  degrees 
Celsius.  The  points  now  are  randomly  distributed  about  a 
mean  of  1000.0124  ohms.  Whereas  each  group  of  five 
resistance  determinations  was  made  with  a very  small  ran- 
dom error  and  an  appreciable  systematic  error,  die  new 


mean  has  a drastically  reduced  systematic  error,  but  an 
appreciable  random  error.  By  taking  the  measurements 
over  a prolonged  period  of  time,  the  systematic  error  of 
each  group  was  allowed  to  very  and  to  become  part,  the 
major  part  in  fact,  of  the  random  error  of  the  measuring 
process. 

Reference  1 describes  the  phenomena  of  errors  chang- 
ing their  nature  in  the  following  terms:  "If  the  cause  system 
is  enlarged,  then  what  was  previously  predictable  bias  may, 
in  terms  of  the  new  cause  system  and  process,  vary  in  a 
random  fashion  and  therefore  be  attributable  now  only  partly, 
if  at  all,  to  bias.  Furthermore,  enlargement  of  the  cause 
system  requires  re-evaluation  not  only  of  the  bias  involved 
in  the  stat^  accuracy  but  also  of  the  stated  precision. " 

Temperature  changes,  like  many  other  causes  of  sys- 
tematic errors,  frequently  occur  in  patterns,  such  as  rough 
sinusoids  or,  in  the  case  of  closely  controlled  environments, 
in  sawtooth  patterns,  not  randomly.  The  random  appearance 
of  the  points  on  the  ^art  of  Figure  S is  due  to  the  random 
selection  of  the  times  at  which  the  measurements  were  made. 
It  is  interesting  to  note  that  an  overestimate  of  the  limits  of 
uncertainty  due  to  random  errors  would  be  obtained  if  the 
points  would  follow  exactly  a sinusoidal  or  a sawtooth  pattern 
and  the  calculations  were  made  as  if  they  were  normally 
distributed.  In  fact,  all  points  of  a sinusoid  are  within  a 
region  bounded  by  0 i /2(ror  within  1.41  standard  deviations 
from  the  mean,  and  all  points  of  a sawtooth  curve  of  isosceles 
trian^es  with  height  h are  within  a region  bounded  by 


or  within  1.73  standard  deviations  from  the  mean 


Figure  5.  Twelve  Means  of  Seto  of  Five  Measurements 
0 Averages  of  values  from  Figure  4. 


The  preoedtng  exemplea  Uluatrete,  therefore,  that: 

1.  A meeauring  proceaa  ordinarily  under  atattatical 
control  win  gri  out  of  control  if  the  ayatematic 
error  of  the  proceaa  varlea,  but  control  may  be 
reeatabllahed  if  enough  changee  are  allowed  to 
occur  and  the  changes  in  ayatematic  error  are 
allowed  to  join  the  chance  system  of  variations. 

2.  If  changes  in  systematic  error  are  allowed  to 
occur,  the  standard  deviation  of  the  me'^suring 
process  wiU  be  larger  than  in  the  abeen...  of 
such  changes,  and  the  sjratematic  error  will  be 
re(hiced. 

3.  The  time  element  win  probably  always  change 
the  "cause  system”  and  transform  constant 
errors  to  changing  errors,  and  parts  of  system- 
atic errors  into  random  errors. 

The  last  example,  however,  raises  another  question. 

Is  the  0, 4-mtlllohm  difference  between  the  mean  awl  he 
certified  value  attributable  to  a systematic  error  or  could 
it  be  caused  entirely  by  the  fluctuations  which  a mean  from 
a limited  number  of  measurements  could  be  expected  to 
display?  Is  there,  in  other  words,  a bias  in  the  measuring 
process  which  should  be  eliminated?  Section  VI  will  show 
one  way  to  answer  this  question. 

IV.  The  Relative  Importance  of  Systematic  Errors 

The  systematic  error  frequently  becomes  the  insur- 
mountable barrier  toward  more  accurate  measurements, 
especially  at  lower  echelon  laboratories.  But  sometimes 
it  can  be  disregarded,  no  matter  what  its  magnitude. 

For  instance,  the  National  Bureau  of  Standards  certi- 
fies standards  to  values  with  uncertainties  relatiw  to  the 
lenl  units  as  maintained  at  NB8.  These  uncertainties 
reflect  mainly  the  errors  accrued  in  comparing  a submitted 
standard  with  the  national  reference  group,  mostly  indirectly, 

i.e. , through  intermediate  standards.  But  they  make  no 
allowance  for  the  systematic  errors  whi  jh  may  be  inherent 
in  the  national  reference  group;  this  part  of  the  systematic 
error  is  the  difference  between  the  magnitude  of  the  unit  of 
measurement  as  represeided  1^  the  national  reference  group 
and  the  absolute  magnitude  of  the  unit  as  the  unit  is  defined. 
This  additional  systematic  error  must  be  taken  into  con- 
sideration when  measurements  based  on  the  legal  unit  (volt, 
meter,  ohm,  kilogram,  etc.)  are  to  be  expressed  in  absolute 
units  or  in  the  fundamental  units  of  phjrsical  measurements 
(kilogram,  meter,  second,  ampere,  kelvin)  from  which  the 
unit  under  consideration  is  derived.  It  must  also  be  taken 
into  consideration  when  measurements  are  compared  inter- 
nationally, i.e.  when  measuremmats  made  in  terms  of  the 
U.S.  legal  unit  are  compared  with  measurements  made  by  a 
foreign  laboratory  which  had  Its  standards  certified  by  a 
different  national  laboratory.  In  the  case  of  the  unit  of 
electromotive  force,  the  volt,  this  additional  aystematie 
error  is  in  1976  estimated  to  be  less  than  one  pari  per 
million  and  probably  less  than  one-half  pari  per  million. 

However,  in  most  electrical  measurements  made  in 
the  I'.S, , the  systematic  error  of  the  national  reference 
group  is  disregarded,  for  it  is  of  no  consequence  as  far  aa 
compatibility  of  measurements  and  production  within  the  U.S. 
are  concerned,  as  long  as  all  measurements  are  based  on 
the  same  reference  group. 

The  same  reasoning  for  disregarding  some  system- 
atic errors  can  be  applied  to  similar  cases  on  a much 
smaller  scale.  The  reference  standard  of  Company  C may 
have  an  uncertainty  due  to  systematic  errors  of  egac.  Since 
all  measurements  made  within  Compssqr  C have  that  common 
systematic  error  component,  the  uniformity  of  production 
and  the  obmpetiMlity  of  subsystem  and  hardware  components 
can  be  assured  even  If  egge  is  neglected.  The  measurements 


within  the  company  are  then  in  units  "as  maintained  at 
Company  C.  *'  Such  an  arrangement  could  greatly  facilitate 
foe  evaluation  of  relative  imoertalntles  of  the  meaaurementa 
made  by  the  various  departments  and  on  foe  various  pro- 
duction lines  of  Company  C,  especially  If  the  products  are 
of  high  precision.  The  previously  neglected  systematic 
error  component  egge  may  have  to  be  taken  into  account  in 
evaluating  the  flnlAed  product.  But  in  aome  instances  it 
does  not  have  to  be  reintroduced  at  all. 

V.  Accumulating  Syatematlc  Errors 

The  question  now  arises:  Given  foe  estimates  for  foe 
maximum  limits  of  all  non-ne^iglble  systematic  errors 
which  must  be  triien  into  consideratian,  how  is  foeir  effect 
on  foe  measurement  estimated  ? If  foe  systematic  error  of 
a measurement  is  dependent  upon  several  systematic  errors 
whose  estimated  maximum  limits  are  given,  how  are  they 
cennbined  to  yield  foe  systematic  error  of  the  measurement  7 

For  a general  discussion  of  foe  treatment  of  systematic 
errors,  let  a system  measuring  foe  Quantity  Q be  described 
Q ° f(a,b,c, . . . )>  where  a,  b,  c. . . are  components  of  foe 
system  representing  the  known  quantities  A,  B.  C. . . The 
magnitudes  of  these  systematic  errors  have  been  estimated 
to  be  not  larger  than  eA,  eB,  cc-  • • . The  propagation  of 
error  equation  then  gives  foe  relative  contribi^on  of  each 
systematic  error  term  to  the  resulting  systematic  error  as 


provided  foe  errors  are  mutually  independent. 

The  application  of  the  propagation  of  error  equation 
(Rsf.  S)  is  illustrated  in  foe  Ap^ndix  with  a few  examples. 

Mindful  of  foe  facts  that  systematic  errors  are  usually 
quoted  aa  "*e<"or ''4e||,  -etg",  i.e.  with  a positive  and  a 
negative  limit,  and  that  they  can  be  only  positive  or  negative, 
but  never  both,  metrologists  have  tended  to  devise  methods 
to  reduce  the  purely  additive  effect  of  foe  individual  terms  of 
equation  1.  llie  aM>st  commonly  used  method  to  reduce  this 
purely  additive  affect  of  errors  is  foe  rsa-method  by  whicb 
the  individual  terms  are  squared  and  foe  square-root  of  foe 
sum  of  foe  squares  used  aa  foe  estimate  of  foe  overall 
uncertainty.  The  conscientious  metrologist  will  in  foe  vast 
majority  of  cases  avoid  surii  an  arbitrary  reduction  and 
adhere  strictly  to  foe  additive  form  of  foe  individual  terms  of 
that  equation  as  written. 

Youden^^  has  shown  foat  foe  combination  of  error  terms 
in  quadrature  yields  erroneous  results  in  a chain  of  labora- 
tories because  it  is  deficient  in  logic.  (See  also  Bef.  10. ) In 
fact,  any  mefood  to  reduce  foe  otunbined  effeets  of  several 
systematic  error  .erms  is  arbitrary  and  can  aeldom  be 
Justified  logically  for  the  followtng  reasons: 


1.  Individual  systematic  error  terms  come  from 
different  populations,  distributions,  having 
different  origins  and  means,  and  are  unrelated. 

2.  bi  most  practical  problems,  foe  number  of 
separate,  individual  error  terms  is  small,  and 
the  probahitity  that  all  error  terms  have  foe 
saase  sign  is  appreciable;  four  error  terms  still 
have  a 11.  B percent  chance  of  ganging  up  wHh 
the  same  si^,  aad  the  coneistsnt  metrologist 
will  net  quote  S-stpna  limits  of  uncertainty  on 
the  randM  error  and  take  a 12.  S percent  chance 
on  foe  systematic  error. 

3.  Although  systematic  errors  are  moaffy  believed 
to  be  overesttmatea,  foey  nmy  also  be  imder- 
eitimales  - m4  freqaeatty  are. 


But  this  problem  appears  to  be  more  a theoretical 
than  a practical  one.  In  accordance  with  Juran's  principle 
of  "the  vital  few  and  the  trivial  many",  in  most  practical 
cases  only  a few  individual  component  errors  determine  the 
magnitude  of  the  resulting  over^  systematic  error,  while 
the  others  are  of  little  or  no  consequence. 

Thus  remains  to  consider  the  theoretically  possible 
but  rare  case  of  a large  number,  say  ten  or  more,  of  sys- 
tematic error  terms  of  approximately  the  same  magnitudtj 
where  some  mutual  cancellation  is  likely  to  occur.  In  this 
case,  the  critical  metrologist  will  accept  any  logical  ration- 
ale to  reduce  the  total  error  to  something  less  than  the  sum 
of  all  individual  terms.  However,  prudence  and  consistency 
would  dictate  that  the  resulting  total  error  be  not  less  than 
the  sum  of  the  nine  largest  individual  terms  when  three- 
sigma  limits  are  quoted  for  the  random  error  and  not  less 
than  the  sum  of  the  six  largest  individual  terms  when  two- 
sigma  limits  are  quoted  for  the  random  error. 


Figure  6 is  a hypothetical  example  of  a control  chart 
for  a 1000-ohm  standard  resistor.  The  resistor  serves  as 
our  standard  and  is  periodically  calibrated  against  a higher 
echelon  standard.  Its  value  Is  established  Iqr  a Trend  Chart. 
Each  time  we  calibrate  a 1000-ohm  standard  resistor  for 
Somebody  else,  we  also  measure  one  of  our  own  1000-ohm 
standards  (in  this  case  the  one  whose  control  chart  appears 
in  Figure  6)  by  the  same  process  and  using  the  same  instru- 
ments, in  a pilot  measurement. 

Each  pilot  measurement  oonsi/.ts  of  a set  of  four 
measurements  taken  at  different  times.  The  mean  of  each 
set  of  four  is  plotted  on  the  3c-chart.  and  the  range,  the 
difference  between  the  largest  and  the  smallest  measured 
values,  is  plotted  on  the  R-cbart.  Upper  and  lower  control 
limits  are  calculated  as  outlined  in  References  2 and  7, 

Although  occasionally  a point  may  fall  outside  the 
control  limits  as  a matter  of  pure  chance,  each  time  this 
happens  the  existence  of  some  abnormality  in  the  measure- 
ment is  suspected,  and  the  measurement  is  repeated.  If  the 
point  of  the  repeat  measurement  also  falls  outside  the  control 
limits,  the  existence  of  an  abnormality  is  taken  as  being 
confirmed.  The  causes  for  this  abnormality  arc  then  deter- 
mined, removed,  and  the  measurement  is  repeated.  If  the 
points  on  the  5c  and  the  R-chart  fall  within  the  control  limits, 
the  measurement  is  considered  valid.  Since  our  customer's 
unknown  standard  was  measured  by  the  same  process,  its 
value  thus  determined  is  also  considered  valid. 

Points  of  the  if  chart  will  reveal  the  existence  of  short 
term  trends  or  cycles,  and  unusual  systematic  errors.  The 
R-chart  is  predominantly  an  indicator  of  the  quality  of  the 
measuring  process,  reflecting,  among  other  things,  the  care 
of  the  operator  and  the  control  al  the  environment  in  which 
the  measurement  was  performed.  Since  a control  chart  is 
the  result  ci  a compilation  of  a considerable  amount  data 
conceding  one  measuring  process,  the  average  experienced 
range  R can  be  used  to  determine  fte  standard  deviati  rr  ■>!  the 
measuring  process.  "Most  experimental  scientists  haie  very 
good  knowledge  of  the  variability  of  their  measurements,  but 
hesitate  to  assume  known  a without  additional  Justification. 
Control  charts  can  be  used  to  provide  the  justification. 

The  last  point  on  the  control  chert  for  averages  and  that 
for  ranges  In  Figure  6 represent  the  last  calibration  of  1000 
ohm  resistors  performed  by  our  lab.  Hie  average  of  the 
four  measurements  taken  on  the  pilot  resistor  charted  in  Fig- 
ure 6 was  X — 1000. 0121  ohms  and  the  range  of  the  four 


VI.  Keeping  Measurement  Errors  Under  Control 


in  a Standards  Laboratoi 


A standards  laboratory  involved  in  certifying  standards 
for  lower  echelon  laboratories  must  make  considerable 
efforts  to  keep  its  errors  under  control.  Ordinarily,  itdoes 
not  suffice  that  the  measurement  errors  are  determined 
periodically  and  that  it  is  assumed  the  errors  thus  deter- 
mined are  typical  and  recurring  at  the  same  magnitude.  A 
positive  proof  that  the  random  error  of  a measurement  was 
indeed  typical  and  that  no  unusual  systematic  errors  have 
occurred  during  the  measurement  would  go  a long  way  in 
enhancing  the  laboratory’s  confidence  in  its  measurements 
and  contribute  significantly  to  an  eventual  reduction  of 
realistically  quoted  limits  of  uncertainty. 

Quality  control  practices,  time  proven  and  honored 
in  production  processes,  provide  us  with  excellent  tools 
for  the  observation  of  the  quality  of  measurements;  Control 
Charts.  "Measurement  of  some  property  of  a thing  is 
ordinarily  a repeatable  operation.  This  is  certainly  flie 
case  for  ttie  tyj^s  of  measurement  ordinarily  met  in  the 
calibration  of  standards  and  instruments.  It  is  instructive, 
therefore,  to  regard  measurement  as  a production  process, 
the  'product'  being  the  numbers,  that  is,  the  measurement 
processes  in  the  laboratory  with  mass  production  processes 
in  industry.  ”*  Reference  2 gives  detailed  instructions  on 
establishment  and  maintenance  of  control  charts. 


Figure  6.  Control  Chart  of  a 1000-ohm  Standard  Resistor 
(Measurements  in  Sets  of  Four) 
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respectively,  as  plotted.  The  estimated  mean  standard 
deviation  of  die  calibration  process  which  yielded  these 
results  is 

^ j = = 1. 07  mllliohms,  (2) 

and  the  uncertainty  of  measured  value  of  1000. 0121  ohms 
due  to  random  error  at  S-sigma  levels  is 

=1.6  mllliohms 

The  factors  A„,  d.,  D.,  and  D.  are  tabulated  in  references 
2 and  7.  2 2 3 4 

The  two  last  points,  like  the  others  before,  fell  within 
the  ciHitrol  limits,  indicating  that  no  abnormal  systematic  or 
random  error  had  occurred  during  the  measurement  and 
that  the  measurement  was,  therefore,  tyfrical  for  this  partic- 
ular process. 

The  distribution  of  the  points  in  Figures  4 and  5 is  not 
necessarily  typical  for  normd  laboratory  comparisons 
between  standard  resistors  where  it  is  frequently  possible 
to  control  the  factors  influencing  the  measurement  (e.  g. 
temperature)  more  closely  and  attain  narrower  uncertainty 
bands,  i.  e.  narrower  regions  bounded  by  control  limits. 

The  difference  between  die  value  of  the  standard,  as 
determined  by  the  Trend  Chart  and  the  grand  average  on 
the  Control  Chart  must  be  considered  a systematic  error  ot 
known  magnitude  and  sign  if  the  difference  is  statistically 
significant.  A significant  difference  must  be  removed 
adjustment  or  by  applying  this  difference  as  a correction  to 
all  measurements  made  by  the  process  under  consideration. 

The  difference  is  statistically  different  at  a level  a , if 
it  is  larger  than 


where  zp  is  the  standard  normal  variaUe  or  the  ordinate  of 
the  normal  curve  for  a cumulative  area  at  p under  the  normal 
curve,  and  where  p = 1 - "l- 


Using  Equation  (3),  we  can  now  answer  die  question  at 
the  end  of  Section  IQ  C.  Let  ns  assume  that  the  average 
range  ct  the  five  measurements  (n=5),  was  R = 0. 7 mllliohms. 
Choosing  a = 5^  or  0. 05,  p = 0. 975.  We  first  calculate  iJi 
from  Equation  (2)  as 
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R 


0.7 

2.326 


= 0. 30  mllliohms. 


'Ihfii,  fitini  Eqiiutiiiii  pi). 

l.'.Hi  o.  20  milliuhms. 

Since  the  difference  betwetvi  our  measured  average  and 
the  certified  value  is  0. -I  milliohms  and,  therefore,  larger 
than  ii , the  difference  is  significant,  and  we  conclu^  that  a 
bias  exists  which  calls  for  immediate  correetiim. 

To  allow  for  changes  in  the  systematic  error  contri- 
buted by  the  measuring  process  or  the  standard,  the  grand 
average  most  be  updated  pertodically,  at  which  time  it  may 
be  necessary  to  omit  some  of  the  ol^st  points  and  recalcu- 
late the  average  on  the  faasla  of  the  latest  poiats.  Retween 
10  and  25  points  should  be  available  for  c^culating  A and  H 
initially,  and  their  valres  shoaM  be  updated  wrhen  additional 
groups  of  points  became  available. 


Vn.  OONCLCaKlN 


The  majority  of  all  sources  of  uncertainty  which  a 
metrologist  normally  enoounters  must  be  treated  as  aystem- 
atlc,  even  though  many  of  them  may  have  origiaated  as  random 
errors.  The  boundaries  between  systeautic  and  random  errors 
are  fluctuating,  and  systematic  errors  may  at  times  recover 
dieir  random  nature  if  we  increase  their  "cause  system”, 

I.e.  fretpimitly  the  time  period  over  tAich  we  consider  fltem. 
The  statistical  treatmeids  developed  for  gte  detennlnatiao 
and  analyses  of  random  errors  do  not  normally  apply  to  sys- 
tematic errors.  We  have  seen  how  we  can  detemrine  the 
magnitudes  of  systematic  errors  of  standards  and  measure- 
ments,  bow  we  can  oontrol  them,  and  how  a control  of  the 
systematic  errors,  combined  with  a oontrol  ot  the  random 
errors  of  measurements,  can  lead  to  a positive  and  definitive 
control  at  die  entire  measurement  process.  Trend  Charts  tor 
standards  and  Control  Charts  for  measurement  processes  are 
Invaluable  tools  for  the  sophisticated  metrologist  to  enhance 
his  knowledge  ot  the  bdiavior  and  uncertainty  of  bis  standards 
and  measurement  processes. 

The  emphasis  is  on  collecting  and  analysing  infcMnnation. 
Pn^r  handing  of  data  can  then  help  to  convert  available 
information  into  a different  form,  but  data  manipulatioo  cannot 
be  a substitute  for  knowledge. 
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